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Abstract 

In this paper we develop a Hamiltonian approach to sufficient conditions in optimal 
control problems. We extend the known conditions for maximised Hamiltonians 
into two directions: on the one hand we explain the role of a super Hamiltonian (i.e. 
a Hamiltonian which is greater then or equal to the maximised one) on the other 
we develop the theory under some minimal regularity assumptions. The results we 
present enclose many known results and they can be used to tackle new problems. 
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1 Introduction 

This paper is the first part of a larger project whose goal is to describe how a Hamil¬ 
tonian approach can be a key instrument in optimal control problems (OCPs). 

Hamiltonian methods have been used in OCPs to state sufficient conditions en¬ 
suring the strong local optimality of a reference trajectory. The main feature of this 
approach is that it allows us to compare the costs of different trajectories by lifting 
them to the cotangent bundle and hence independently of the control values. The 
seminal idea goes back to 1879 when K. Weierstrass discovered a method which en¬ 
ables one to establish a strong minimum property for solutions of Euler-Lagrange’s 
equations, i.e. for stationary curves. We can summarise Weierstrass’s method as a 
combination of a local convexity assumption on the integrand and of an embedding 
of the given curve in a suitable field of non-intersecting stationary curves. The exten¬ 
sion to optimal control requires some efforts since one has to deal with the maximised 
Hamiltonian coming from the Pontryagin Maximum Principle (PMP). The PMP was 
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introduced in 1956 by Lev Pontryagin and it is an extension to OCPs of the Euler- 
Lagrange’s equation for the Calculus of Variations (CV). One of the main difficulty 
being that the maximised Hamiltonian in OCPs does not possess the same regularity 
properties as the one in the CV. 

The goal of this project is to propose a unified Hamiltonian approach to sufficient 
optimality conditions for OCPs whose state evolves on a manifold M. These results 
include some known ones, emhpasizing their common features, and will allow us to 
tackle new problems. 

The leading ideas of the project are the following: 

• To use the symplectic properties of the cotangent bundle to compare the costs 
of neighbouring admissible trajectories by lifting them to the cotangent bundle. 

• To define in the cotangent bundle T*M a suitable Hamiltonian flow T-Lt ema¬ 
nating from a horizontal Lagrangian submanifold A. This flow is the one of the 
maximised Hamiltonian when this last is at least 

• To estimate the variation of the cost of admissible trajectories by the variation 
of a function of their final points and, if it is the case, their final times. 

• To obtain a suitable second order approximation (2"''^ variation) in the form of 
a coordinate-free Linear-Quadratic (LQ) problem and to require its coercivity. 

• To show that T-Lt* (the derivative of Tit along the reference extremal) is, up to 
an isomorphism, the linear Hamiltonian flow associated to the LQ problem. 

• To use the coercivity of the 2"''^ variation to substitute the manifold described by 
the transversality conditions, Aq, by an horizontal one A. This can be obtained 
by adding a penalty term which reduces the problem to a problem with free 
initial point and whose 2”’'^ variation is still coercive, see M. Hestenes m- This 
allows us to overcome a difficult point: in optimal control problems, for lack of 
controllability it may happen that the projection of the flow starting from Aq 
at t = 0 is not locally onto for a non-trivial time interval. 

• To deduce for a problem with free initial point and fixed final point that the 
projection on M of Tit emanating from A is locally invertible so that we can go 
back to the first issue and we can compare the costs of neighbouring admissible 
trajectories by lifting them to the cotangent bundle. 

• To use again the coercivity of the 2”'^ variation to complete the proof for the 
general case. 

The project goes back to some initial papers [1] and [3] where the use of this kind 
of approach to OCPs for the case when the maximised Hamiltonian is at least 
did begin. 

In [1] the authors studied a Bolza problem in M” on a fixed time interval and 
with general end-points constraints. They assumed that the data are uniformly 
quasi— see Definition 1 therein, where the quasi refers to the fact that the data 
are time-dependent, moreover, under the strengthened Legendre condition, assuming 
that in a neighbourhood of the reference Pontryagin extremal the local maximum of 
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the Hamiltonian coincides with the global maximum they proved that the maximised 
Hamiltonian is quasi—C^. 

This kind of regularity allows us to look for second order conditions which will 
guarantee that the abstract theory can be applied to obtain strong local optimality. 

When the state evolves on manifolds, the first issue is to prove an invariant 
version of second order conditions; this problem has been addressed in [3] for a 
Mayer problem on a fixed time interval. This result can be obtained by pulling 
back the control problem to a neighbourhood of the initial point xq, in this way the 
second order approximation leads naturally to derive a Hamiltonian formulation of 
the second variation as a linear-quadratic optimal control problem on T^qM with 
control functions in L^. This formulation is coordinate-free and hence invariant. 

In the book [2], dedicated to the geometric approach to control problems, the 
smooth case is investigated in a Hamiltonian setting for a Bolza problem with fixed 
end points; in [9] the authors present a numerical algorithms to compute the first 
point where the trajectory ceases to be locally optimal. 

The assumption that the data are uniformly quasi—can be weakened as shown 
in [5] by imposing conditions directly on the Hamiltonian flow (Theorem 2.3 therein), 
these conditions make sense even if the second variation does not exist and, when 
the second variation exists, they are implied by its coercivity. 

Here we develop the hrst part of the project and we relax the regularity assump¬ 
tions on the Hamiltonian in such a way that they guarantee the existence and the 
regularity of the flow so that this technique can be applied to a larger class of different 
OCPs. The Hamiltonian we consider can be either the maximised Hamiltonian or a 
suitable super-Hamiltonian which is not necessarily equal to the maximised one but 
which will be needed in the study of problems where the control contains a singular 
arc. 

The regularity assumptions we propose allows us to use the symplectic properties 
of Hamiltonian flows (Lemma 13.3p to state abstract sufficient optimality conditions 
for a Bolza problem (Theorem 13.9|) and we show their possible applications to a 
minimum time problem (Theorem [3T5]) . 

In the final Section 0] we briefly summarise the optimal control problems where 
our assumptions are satisfied and this approach has been used. 

In a forthcoming paper we will give a more detailed description of this approach 
and larger set of references, furthermore we will give some suggestions about possible 
extensions and further investigations. For different approaches here we quote only 
0, m, [E] and reference therein. 

1.1 The problem 

We consider the following optimisation problem 

Minimise 

J(r, e, v) = coim)+cMT)) + dt (1.1) 

Jo 
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subject to 


iit) = a.e. t G [0, T] (1.2a) 

e(t) G M (1.2b) 

e( 0 )GiVo, ^{T)eNf (1.2c) 

V G L°°([0, T],U), U C M”^. (1.2d) 


The final time T can be fixed or variable, M is a n-dimensional connected paracom- 
pact smooth manifold M and the state end points constraints Nq, Nf are smooth 
connected embedded submanifolds of M. We assume that cq, c/, f^, f are defined 
on open sets and that they are C°°. 

We take smooth time independent data becanse we are interested in the irregularities 
arising from the maximisation of the Hamiltonian. 

The conple v) is called admissible if it a solution of (|1.2al) which satisfies the 
constraints (ll.2bp - (ll.2cp - (|1.2d() . in this case we refer to ^ as an admissible trajectory 
and to V as the associated control. 

We consider as a candidate optimal solution a given reference admissible tra¬ 
jectory ^ which is identified by the triple (T, v) and we study its strong local 
optimality according to the following Definition ll.il 

Definition 1.1. [Strong local minimiser] 

The reference admissible trajectory is a strong local minimiser of the above con¬ 
sidered problem dLU), if there are neighbourhoods IX C R x M of the graph of 
denoted by T^, and 0 C R x M of (T, ^(T)) such that is a minimiser among all 
the admissible trajectories ^ satisfying 

C U, (T, ^(T)) G 0 
independently of the associated control. 

When the final time is fixed this definition reduces to the usual definition of 
strong local minimum which uses the topology to describe a neighbourhood of 
the admissible trajectories; whereas in the case of variable end time our definition is 
local with respect to the graph of and hence local with respect to both the final 
time and the final point. 

This notion has been called time-state-local optimality in |23j-|24j. where it is 
used also a stronger version of optimality, called state-local optimality. 


2 Notations and preliminary results 

We recall that for every connected paracompact smooth manifold M (see [H]) there 
is a Riemannian structure which induces a distance dM on M and the metric topology 
is the same as the original topology. This distance allows us to talk about Lipschitz 
property for maps on manifolds. 

The next definition will be used to describe the main regnlarity assumption which 
is a strengthening of the usnal Caratheodory-type assumption. 
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Definition 2.1. Assume that M,N are finite dimensional Riemannian smooth man¬ 
ifolds and J is an open interval in M. We will say that the map G : J x M ^ N is a 
Lipschitz-Caratheodory map if it satisfies the following 

i. For almost every t ^ J the map x ^ G{t, x) is locally Lipschitz. 
a. For each x € M the map t !->■ G{t, x) is bounded measurable. 

Hi. For any compact set K M there is an essentially bounded measurable function 
m such that 


dNiGft, x),G{t, y)) < m{t) duix, y), x,y £ K 

When G is a time-dependent vector field and hence N = TM is the tangent space 
to M, this hypothesis assures existence, uniqueness and Lipschitz continuity in {t, zq) 
of the solutions of the differential equation 

C(t) = G{t, C), C{to) = zo, to G J. 

Moreover we will use it in an analogous but simpler way when = M to obtain that 
the Lipschitz continuity of {t,z) i-7> G{s,z)ds. 

Let / be a vector field on the manifold M and (/? : M —>■ M be a smooth function. 
The action of / on (directional derivative or Lie derivative) evaluated at a point x 
is denoted with one the two expressions 

Lfip{x) = {d(p{x)J{x)). 

For any C^-function ip such that dip{x) = 0 the second derivative D‘^ip{x) is well 
defined as a bilinear symmetric form on TxM. 

Finally we identify any bilinear form Q on a vector space V with a linear form 
Q : V V* and we write 

Q{v,w)-.= {Qv,w), Qlvf'■.= Q{v,v,). 

Remark 2.2. We will sometimes omit writing explicitly that equalities between L°° 
functions hold almost everywhere unless we need to emphasise it. 


2.1 Symplectic notations 

For a general introduction to symplectic geometry and its application to variational 
problems we refer to [7] while for more specific applications to optimal control we 
refer to [T]. 

Denote by tt : T*M —>■ M the cotangent bundle; it is well known that T*M 
possesses a canonically defined symplectic structure, given by the symplectic form 
(Ji = ds{i), where i denotes an element of T*M and s is the Liouville canonical 
1-form s(t') = .^ o TT*. 

If Qi are local coordinates on the base manifold M and pi the fibre coordinates 
then in local coordinates we can write 

n 

s ■= '^Pidqi, cr := '^dpi A dqt, 
i=l i 
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where d denotes the exterior derivative and A denotes the exterior product. 

We recall that the symplectic structure allows us to associate, with each time 

—¥ 

dependent locally defined Hamiltonian Ht : T*M ^ R a unique vector field Ht on 
T*M defined by the action 

This vector field defines a corresponding Hamiltonian system 

X{t) = Ht{X{t)), X{0)=e, a.e.te[0,T] (2.1) 

and we will denote its flow by £ i-A Note that for any time dependent object 

we will use the notation 

= Mt{£) = Meit) 

when one of the variables is to be considered as fixed. 

2.2 The Pontryagin maximum principle 

We assume that the candidate optimal solution ^ is a state extremal and with this 
we mean that it satisfies the PMP, see Assumption 12.31 
For simpler notations we set 

xo ■= ?( 0 ), Xf := C{T) 

To state the PMP we introduce three Hamiltonians; if U is the common open domain 
of both / and let H := C T*M. 

We define 

1) the (control dependent) pre-Hamiltonian T : H x [/ —>■ M as 

F : {l,u) eA {£,f{Tr{£),u)) - po 

2) the time dependent reference Hamiltonian T : [0, T] x H M as 

F: (t,£)^F(AT(t)), 

3) the maximised Hamiltonian Fmax : H ^ M as 

Fmax(^) := snp F{i,u). 

u&U 


Let us remark that the maximised Hamiltonian could take the value +oo. 

All the above Hamiltonians depend on the parameter po which can take the values 
{0,1} characterising, respectively, the abnormal and normal case. 


6 


Assumption 2.3. [Pontryagin Maximum Principle] There is a non-trivial couple 
{po,\), where po € {0)1} ^ ■ [0) T] —>■ T*M is a lifting of to T*M, (i.e. 

vr o A = satisfying the Hamiltonian system 

—> 

A(t) = Ft(A(t)), a.e. t e [0, f], (2.2) 

the transversality conditions 

A(0) = pq lico(xo) on T^^Nq 
A(f) = -po dcf{xf) on 

and the maximisation property 

Ft(A(t)) = maxF(A(t),n) = Fmax(A(i)) 

uGU 

Moreover Ft{\{t)) is constant and it is zero when the end time T is variable. 

A is the Pontryagin extremal associated to the state extremal For simpler 
notations we set 

io:=m, if:= Xif). 

It is not difficult to see that the two functions PqCq and PoCf act on Nq and Nf, 
respectively, but they can be extended to an open set in M in such a way that the 
transversality conditions (12.3p and ()2.4I) hold on the whole tangent space. Namely 
we denote by a, /3 : M —)■ M two locally defined functions such that 

a = poCq on Nq, £q = da{xo) (2-5) 

fJ = PoCf on Nf, £f = —df5{xf). (2-6) 

The transversality conditions can also be expressed as 

?0 G Ao := {da{q) + w : g G Aq, o; G T^Nq} 

If e Af := {-dld{q) + u : q e Nf, io G T^Nf} 

where ” means orthogonal with respect to the dual coupling. 

In the normal case a, fd are cost functions equivalent to the original ones while in 
the abnormal case they are extensions of the zero function on the constraints. 

When pq = 0 all the costs disappear from our conditions and indeed we will study 
a problem with a zero cost. Proving that ^ is a strict minimiser will imply that it is 
isolated among the admissible trajectories. 


(2.3) 

(2.4) 


3 A Hamiltonian approach to optimality 

In this section we extend the known results for a maximised Hamiltonian in two 
different directions. We first prove that the Cartan form maintains its symplectic 
properties under weaker regularity assumptions on the Hamiltonian, Section 13.11 
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Afterwards, motivated by the singular case where the maximised Hamiltonian does 
not possess the required regularity properties, we introduce a super-Hamiltonian 
which can be used to compare the costs of admissible trajectories by lifting them to 
the cotangent bundle. Section 13.21 Using these results we prove abstract sufficient 
conditions. Section [3^31 

3.1 The Cartan form 

Let a : M —)■ M be a smooth function and let A be the graph of da on a contractible 
open set. A is a Lagrangian submanifold of T*M and it is known that 

S|A = d{a o tt). 

Let 0 be an open set in T*M and J C M be an open interval, with J D [0, T], and 
0 D A, we consider a time dependent Hamiltonian 

H : J X 0 CRx T*M R. 

Associated to this Hamiltonian we consider the Cartan form on J x 0 


u = s —Hdt . 


The following assumption describes a set of minimal regularity conditions which the 
Hamiltonian H has to guarantee to develop our approach. In specific examples the 
properties of H will be different but they will imply this kind of regularity. 

Assumption 3.1. Assume that 

1. The flow 

{t,i) € JxAe^n{t,i) £T*M 
is well defined and Lipschitz continuous. 

2. The function 

{t,£) eJxAe^intii), 7r,Htont{i))-Htont{i)€R 

is Lipschitz Caratheodory (Definition \2. 1\) 

Thanks to Assumption 13.11 the Cartan form defines a Lipschitz function 6 : J x 
A ^ R which will play a crucial role. Let 

9{t,i) := {a o TT){i) + f u = 
d'H£\lo, t] 

= {a o 7r)(£) + [ {ns{£), tt.Hs o UsiL)) -H^o Us^ds (3.1) 
Jo 

and hence 

dte{t,i) = {nti£),7r,Htont{i))-Htont{i) a.et^J ( 3 . 2 ) 
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Let us now prove that, also in this case, the classical property of the Cartan form 
holds, that is the form 'H*u \s exact on J x A. 

We will consider differential 1-forms with possibly coefficients; these forms are 
called (Whitney) flat forms and their properties are presented in |15] . The general 
theory is fully presented in Whitney’s monograph [28], see also m- We do not use 
the results in their full extent, what we really need is the chain rule for Lipschitz 
functions as it can be found in Lemma 4.6.3 in m and a suitable version of the Stokes 
Theorem; an explicit proof is in |3] but the essential elements needed for the proof 
are contained in the cited books, m for the general case or m for the Lipschitz 
one. 

The following lemma is the first step to prove that the form 'H*u is exact on J x A. 
Lemma 3.2. For every given t £ J the form T-Lls is exact on A and 

nlsii) = dOtii) a.e. ieA (3.3) 

Proof. It is equivalent to prove that for every Lipschitz curve 7 : [0, 1] —> A 



Let us consider the set 



^'*( 7 ( 1 )) - 


A := |(r, s) ; 0 < r < t, 0 < s < l| 


and the map 


(j) : (r,s) 'H{T,-f{s)). 


by the Stokes theorem we have 


(T= S+ S- S- S = 


’|S = 0 '^(P\T = t 


S=1 (P\t=0 


moreover 


/ ^ 

•^^^(0)|[0,t] ■^^7(i)|[0.t] •^T'KO.I] 

\^Ht- o TiT- o 7(5), ds s)^ dsjdT 
{dHr o (/)(r, s), ds s)) ds'^dr = 

) T-L'y{i) dr + I Hr o dr 



by equating the two right hand sides we obtain 


7 ( 0 ) 


/ I 


u = 


7(l)|[0,tl ^7(0)|[o,t] 


= d{t, 7 ( 1 )) - e{t, 7 ( 0 )). 


□ 
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We are now able to prove the main result of this section 
Lemma 3.3. The differential form TTuj is exact on J x A and 

'H*uj = de a.e. {t,i) e J X A 

Proof. We can equivalently prove that for every Lipschitz curve 

^ t G [0, 1] i-7> {t,j{t)) € J X A 


we have 

[n*u= [ d6 = e{i,^{i))-6{o,j{o)). 

J ^ J 

By definition we have that 

[n*uj= [n*s- [ H{s,'HsOj{s))ds = 

J fi J fi Jo 

= j {Us 0^(3), -^ 7 rUsOj{s))ds - [ H {s,nsOj{s))ds = 




■k^H soUs o 7(5)) - H {s, Us o 7(5)) ds+ 
+ / {Us o'y{s), Tr^Us*'yis))ds 

Jo 

and by (13.2|) and (13.31) 


/ U*u = 

If! J fl 


[ dse{s,i)ds+ [ dOsii) 
J u J u 


= (i6»(s,£) = 6'(1,7(1)) - 6»(0,7(0)). 

J fL 


□ 


When the state projection of the Hamiltonian flow is invertible we obtain some 
important properties of the function 9. We recall that a homeomorphism between 
metric spaces is said to be bi-Lipschitz if it is Lipschitz and has a Lipschitz inverse. 

Lemma 3.4. Suppose that, for a given t £ J, the function nUt is bi-Lipschitz then 
on TTUt{A) 

(i) d (j)t o {nUty^'j =Uto {nUty^. 

(a) The function at := 9t o yUty^ is a function. 

(Hi) At := Ut{A) is the graph of dat. 

Proof. 

Since 9t o {nUty^ is Lipschitz then by the chain rule we can prove (i) by proving 
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that their integrals coincide over any Lipschitz curve 7 : [0, 1] — Trl-Lt(A). 
By (13.3p we have 


d[eto{'KUt) = y {d (Ot O {TrUt) ( 7 ( 5 )), 7 ( 5 )) ds = 

= [ {d9t o {TrUty^ {-f{s)), {TrUt)^^ j{s)) ds 
Jo 


[ det= [ 

J{•K'Ht) ^07 Jh 

fl 


-HU = 


{•K'Ht) 07 

d 


/o 


{UtoyT-Lt) ^ ilis)), ^ yj-Lt) ^o7(s)^)ds = 


= / CHto yjit) ^ y{s)), j{s))ds 
Jo 

which proves statement (i). (ii) Follows immediately from (i). To prove (hi) it is 
sufficient to notice that 

Kt = ntoy'Ht)-yT^nt{A)). 


□ 


3.2 The super Hamiltonian and its properties. 

Throughout this section we assume that a satishes (|2.5I) and that A is the graph 
of da on a contractible neighbourhood of xq. Moreover we assume that H satisfies 
Assumption 13.11 and the following Assumption 13.51 this last motivates the name of 
super-Hamiltonian. We underline that these assumptions concern jointly the super- 
Hamiltonian and the horizontal Lagrangian manifold A. 

Assumption 3.5. The Hamiltonian H satisfies the following 



(3.4a) 

Ht 0 X{t) = Fto X{t) = Fmax 0 x{t), a.e. t E J 

(3.4b) 

HfiXit)) = Ft(X{t)), a.e.teJ. 

(3.4c) 


As a consequence the Pontryagin extremal A is also a solution of the system 

X{t) = Ht{X{t)) a.e.t£[0,f]. (3.5) 

Remark 3.6. If the maximised Hamiltonian Tjnax satisfies Assumption 13.11 then it 
satisfies also Assumption 13.51 for example in the classical case when Tmax is we 
can take H := Fmax for any A. 

From Assumption 13.11 it follows that there exists an interval I := [0, T] with 
T > T such that Htiy) is defined for f E I and we have ^t(f'o) = on [0, T], 
Moreover from the compactness of the time interval I, it follows that there is an 
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open neighbourhood 0^^ of Iq such that, without loss of generality, we can redehne 

A := A n 0^^, to obtain that % is defined on / x A and T is dehned on [0, T\ x A, 

—>■ 

where J- is the flow of Ft. 

To prove the main Theorem we need a final crucial assumption concerning the 
invertibility of the projection of the flow of the Hamiltonian onto the state space. 

Assumption 3.7. Assume that the function 

idi X ttH : {t,£) E I X A ^ {t,7rnt{i)) £l xM 


is bi-Lipschitz between I x A and an open set 'll of I x M containing the graph of f. 


To verify the bi-Lipschitz assumption one can use one the the available inverse 
function theorems for locally Lipschitz functions which are based on the local invert- 
ibility properties of 'KfHt* in [0, T] x {f'o}- We refer, for example, to the one proposed 
by F. Clarke in [12]. 

Remark 3.8. For optimal control problems where the initial point is free the problem 
is always normal, moreover the initial Lagrangian manifold Aq is itself horizontal and 
we take it as A. In general, however, this is not the case and one has to define an 
appropriate a, in our approach we expect that the suitable a can be obtained from 
the second order conditions as it is the case in the applications we describe in the 
final Section HI 

We can now state the main Theorem which compares the reference cost with the 
cost of an admissible neighbouring trajectory. 


Theorem 3.9. Under Assumvtion \3.1[\3.5[ - 3.7\ , let ^ : [0,T] —>■ M be an admissible 
trajectory whose graph is contained in U and let p{t) := o ^(t) then 


PO (J(r, v) - J(f, f", u)) > mT)) + 0{T, p{T)) - /3(%) - 0(f, 4) (3.6) 

Proof. Let p := Tit o p he the lift of to T*M, by Lemma 13.31 we obtain 

0 = £ [{p{t), iit)) - Ht o Pit)] dt + 0(f ,4) - OiT, piT))+ 

- J ft°^it)) - Ft oX{t)] dt + ainipiO))) - a(7r(4)) = 

= £ {(hit), m - Ht O Pit)] dt + 0(f ,4) - OiT, piT))+ 

+ [ Pofi^it),vit))dt- [ po fif.it), vit))dt+ 

Jo Jo 

- j {(^(^)) ft°ft)) -Ftoft)]dt + aifiO)) -a(xo)-h 

+ [ Pofifit),vit))dt- [ pofiiit),vit))dt. 

Jo Jo 


12 





If we isolate, on the left hand side, the terms which describe the costs of the two 
trajectories we obtain 

«(?(0 ))+/ pof{({t),v{t))dt = 

Jo Jo 

-Pof{^{t),v(t)) - Ht O p{t)} dt+ 


/ 


+ 


{(A(t), f(J{t),v{t))) - Pof(I{t),v{t)) - Ft oA(t)|dt+ 


-e{T,io) + 9{T, p{T)) = 

= - [ {F{p{t),vit))-Htop{t)}dt-e{f,£o) + e{T,p{T)) 

Jo 

where we have used the definition of F and of F. Now by the (I3.4all property of the 
super Hamiltonian, by adding to both sides I3{^{T)) — j3{xf), and recalling that on 
the initial manifold a = pqCq and on the final manifold fj = PqCj we obtain 


□ 


po J(r, I, v) - J(T, e, n) > mT)) + 0(T, p(T)) - /3{xf) - 0(T, 4) 


3.3 Abstract sufficient optimality conditions. 


We are now able to state an abstract theorem which reduces the strong local opti¬ 
mality of an admissible reference trajectory ^ to the local optimality of a suitable 
function of the right end point (T, Xf) of the graph of 
Let 

<I>: (t, x) G 'll !-;> /3(x) -|- 9{t, (x)) = (/3 + at)(x) G M, 

where at = T-Lt o was defined in part (ii) of Lemma 13.41 By means of this 

function we can rewrite the inequality (I3.6j) as 


Po[jiT,^,v)-J{f,lv)) > 4>(r,^(r))-<I>(f,%). (3.7) 

This relation will allows us to characterise the minima of the function pqJ by studying 
the function at the reference point (T, Xf). Indeed we can now state a sufficient 
optimality condition 


Theorem 3.10. In the normal case, po = 1? under Assumptions \d.lWS.,^3.T\ if 
there exists a neighbourhood 0 of (T, Xf) in Nf such that (T,Xf) is a minimiser of 
$ restricted to 0 then (T, 4 is a strong local minimiser. 

Proof. It follows immediately from (13.7p . □ 


Remark 3.11. When the initial point is free we have that a = cq, if, moreover, the 
final point and time are fixed then the right hand side of (13.711 is zero and we can 
prove that ^ is a strong local minimiser by only verifying Assumptions I3.1II3.5H3.7I 
for the given A. In the other cases we have to find a suitable A and to prove the 
minimality property of at {T,Xf). 
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Remark 3.12. Concerning the abnormal case, po = 0, if one can prove that the 
minimum is strict then, as a byproduct, it follows that ^ is isolated among the 
admissible trajectories. To prove that ^ is a strict strong local minimiser the first 
step is to require that (T, Xf) is a strict local minimiser for in this case, if we have 
another minimiser (T,^,u), we can conclude that T = T and ^{T) = Xf. From the 
proof of Theorem 13.91 we have 

0 =Po = - j {F{p{t), v{t)) - Ht o p{t)} dt. 

By Assumption (I3.4al) we obtain that 

F{p{t), v{t)) — Fit o R{t) = 0, a.e. t € [0, T]. 

On the other hand, since p = T-Lt° o | we have that 

p{t) = Ht{p{t)) a.e.t G[0,f]. 


If 

7r^Ht{p{t)) - = 0 a.e. t G [0,f] (3.8) 

then one can conclude that p = \ since they both satisfy the same Hamiltonian 
equation with the same boundary conditions. Unfortunately Assumption (I3.4ap is 
too mild to prove (13.81) . We can strengthen it by assuming that 

Hti£) > F^^^ii), i G 0 (3.9) 

where 0 is a neighbourhood of the range of A; we note that this is true if Ht = Tmax- 
From this new assumption we deduce that 

F{£,v) - Ht{i) = 0, \/£ : tt£ = C{t), a.e. t G [0, f], (3.10) 

hence by (j3.10p 

0 = dyF{p{t),v) - dyHt{p{t)) = -n^Htipit)) - f{^{t),p{t)), (3.11) 


where dy is the vertical derivative along the fibre. This is not the only way to obtain 
local uniqueness of the strong minimiser; for the case of singular control see for 
example [23], [TO] . 

To state necessary and/or sufficient condition for (T, x/) to be a local minimiser 
for we compute its hrst and second derivatives. We note that, by Lemma 13.41 
the function is a function of x at f hxed and Lemma 13.131 states that the 
point (r, Xf) is a critical point for the function without further assumptions on 
the data. On the other hand to obtain the existence of second derivatives we will 
require stronger regularity assumptions on the data which here we do not specify. 
We underline that since the first derivatives are zero, then the second ones are well 
defined as a quadratic function on R x Tj M 
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Lemma 3.13. Under Assumvtions \3. iT43.5HX7| we have that 
(i) dx^{t,x) = dl3{x) +T-Lto {nT-Lty^ (x) = d{l3 + at){x), tel 
(a) dt^{t, x) = —Ht oT-Lto (x) = —Ht o {dat){x), a.e. tel. 

Moreover 

d$(T, Xf) = 0. 

Proof, (i) follows immediately from Lemma (I3.4h . To prove (ii) from (13.2p and 
Lemma (13. 4p we have 

dt^{t,x) = dt0{t, {TTPity^ (x)) - {d (^6t o yUty^^ (x), 'K^HtoHt o {TiUty^ {x)) = 

= dt6{t, yuty^ (x)) - {Ut o {-KPLty^ (x), oi-Lto ypLiy^ (x)) = 

= - Hfonto {nTity^ (x). 

Computing these derivatives at {T,Xf ), by the transversality condition (12.411 . we 
obtain 

dx^{T,Xf) = dl3{xf) + PLj, o (^Tr'Hji) ^ (x/) = 

= djdixf) + £/ = 0. 

By Assumption (I3.4bl) and by the PMP with variable final time we have 

dMTyy = -Hyif) = -Pyiy = o. 

When the final time is fixed we are not interested in this derivative. □ 


Lemma 3.14. Let Assumptions 1,9. iU,?. ,51 - d. 7 hold true and assume moreover that 
is in a neighbourhood 0 of (T,Xf), then 

1. dxx^{Tyf)[5xf‘ = + ay){xf)[5xf‘ = a (^{dayyxyyyyx) 


2. dtx^{T,Xf)5x = -LsxLpaf{xf) = cr yHyif),{dayyx 

3. dtt^if,Xf) = -dtH{f,Xf) - L\ af{xf) = 

Jt 

= - {dtH{f, Xf) + a (^{dayj^, ^ . 


Notice that since 


PLf o yiLf) ^ then {da^ 




Proof. 

1. It follows directly from Lemma 13.131 part (i). 

2. -3. From Lemma [3.131 part (ii), taking into account that Hf{£f) = Fj^{£f) and 
some known symplectic equalities, that can be easily obtained in coordinates, we get 


dtx^{T,Xf)5x = - a ^{dayyx,Hyif) ] = 
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and 


dtMT, Xf) = dt Tit (TTHt)-^ (%))) = 

= - dtH{f,xf) + ^ = 

= - dtH{f,Xf) + a- (^{daf)^ff{xf),Hf(£f)^ = 

= - dtH{f,Xf) + af{xf). 

Jf 

□ 


3.4 The Minimum Time Problem 

In this section we apply the results of the previous sections to the minimum time 
problem which is a special case which can be obtained from the general one by setting 

co = Cf = 0 , f = 1 . 

For the minimum time problem we obtain a sufficient condition which do not involve 
the second derivatives of but requires more regularity of the super-Hamiltonian 
’’near the final time” and a second assumption which is clearly verified when final 
point is fixed. 

Theorem 3.15. Let Assum,ption,s \S. iU,?. ,5If3r7| hold true and assume moreover that 

1. The function {t, x) {x) is Lipschitz in a neighbourhood of {T, Xf) 

in M X M, with a Lipschitz constant given by L > 0. 

2. Hto {TrUty^ (x) eT^Nf, {t,x) e x G Nf 

if Po = 1 (normal case), then [T, is a strong local minimum for the minimum time 
problem. 

Proof. Let k be the dimension of the submanifod Nf, we can take local coordinates 
centered at Xf such that Nf is homomorphic to the plane given by the last n — k 
coordinates equal to zero, so that we can consider the problem on M x M” with Xf = 0 
and yP) € 

For the minimum time problem in the normal case equation (j3.7jl reads 

r - f > ck(r, yr)) - $(f, %) = ey, (e(T)) - 9{f, %). ( 3 . 12 ) 

By contradiction assume there exist admissible trajectories y '■ [0, tn] M, t^ < T, 
whose graph is contained in 'Ll and such that 

T — tn ^ 0 , and ||Cn(in)|| 0. (3.13) 


Consider the curve 


7 := t G [tn, T] 


f-t 

T -tn 


f,n (fn) 
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which is such that 7(tn) = Cnitn) and 7 (T) = 0. By Lemma [331 and Assumption (ii) 
we get from equation (I3.12h 


tn-T> / o (vr'Ht) ^ i'yit)),'y{t)) - Hto {irnt) ^(7(t))|(it 

J tn 

rf 

-1 


Ht o {'K'Ht) {l{t))dt 


Since ^ (xf) = io hy (|3.4bp and Assumption (i) we can write 


T-tn< I Hto{'KUt) ^{j{t))dt = 


^ {y{t)) - Hfo ['K'Hf) ^{xf'^dt < 


< 


Ht o {■K'Ht) ^ {l{t)) - Hfo {n'Hf) ^ (%) 
f-t 


- / ^r-'+T-/ 

J tn \ J. t 


-||?n(tn)|| dt = 


dt < 


T - tn 


Dividing by T — > 0 we obtain 


1 < ^ {f - tn + Un{tr^ 


which yield a contradiction by (I3.13p . 


□ 


4 Final Comments 

This general unified Hamiltonian approach can be used in different situations which 
has been already addressed in some published papers, where second order conditions 
have also been developed and appropriate H and A have been defined to obtain 
sufficient conditions for strong local optimality, here we briefly summarise them. 

• Bang—bang control. 

In this case H := is continuous and 'H piecewise C°^ and Lipschitz. The 
case when there are a finite number of simple switches is studied in for a 
Mayer problem with variable end-points on a fixed time interval and in [20] for 
a Bolza problem, while the corresponding minimum time problem is studied in 
[23] . The double switch case is addressed in [21] for a Mayer problem and in 
[22] for the minimum time problem. The numerical analysis with Maple of a 
case study is in [27]. 
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• Totally singular control 

In |26] . for a Mayer problem and a single-input system the author first in¬ 
troduced a super-Hamiltonian, this step was essential because the maximised 
Hamiltonian does not define a regular flow. In [24] and [25] the result for the 
minimum time problem has been obtained as a by-product of problems with 
controls containing bang and singular arcs. Furthermore in m the minimum 
time problem has been studied in the multi-input case for a system where the 
controlled vector fields generate an involutive Lie algebra, while in |10| this last 
assumption is removed. We notice that the super Hamiltonian, and hence its 
flow, is C'°° in a neighbourhood of the range of A but it satisfies Assumption 
13.51 only starting from a submanifold of T*M containing A, as we require. 

• Bang—singular control 

The last application we consider is the case when the reference trajectory con¬ 
tains both singular and bang arcs. The obtained results concern the minimum 
time problem for a single-input control system. In [24] a bang-singular-bang 
trajectory in a problem with fixed end points is addressed, while in [25] it is 
considered a bang-singular trajectory with the initial point fixed and the final 
one constrained to the integral line of the controlled vector field. In this case the 
flow of the super Hamiltonian is sufficiently regular and satisfies Assumption 
13.51 only starting from A. 
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